Papers by Kelly Chutong Li
AlignFreeze: Navigating the Impact of Realignment on the Layers of Multilingual Models Across Diverse Languages (2025.naacl-short)
Copied to clipboard
| Challenge: | Realignment techniques are often employed to enhance cross-lingual transfer in multilingual language models, but can degrade performance in languages that differ significantly from the fine-tuned source language. |
| Approach: | They propose a method that freezes either the lower half or upper half of the layers during realignment to prevent performance degradation. |
| Outcome: | The proposed method improves Part-of-Speech (PoS) tagging performance in languages where realignment fails. |